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1.  Introduction 


Temperature  measurements  of  fast,  destructive  events  (e.g.,  combustion,  or  high  explosive 
detonations)  presents  many  challenges.  Conventional  methods  employing  thermocouples, 
resistance  temperature  detectors,  or  diodes  are  intrusive  and  suffer  from  slow  response  times. 
Optical  pyrometry  is  an  alternative  method  that  offers  advantages  over  these  conventional 
methods.  Optical  pyrometers  are  capable  of  operating  at  large  standoff  distances  from  the 
experiment,  negating  the  potential  for  damage,  and  possess  response  times  in  the  GHz  range. 

High  speed  optical  pyrometry  possessing  high  spatial  and  temporal  resolution  may  be  achieved 
with  digital  color  imaging  devices  that  use  either  charge  couple  devices  (CCD)  or  comple¬ 
mentary  metal  oxide  semiconductor  (CMOS)  sensors.  Infrared  focal  plane  arrays  with  InSb 
photodiodes  have  been  used  to  measure  temperatures  of  in-flight  slugs  hred  from  rifles  (1). 
Visible  spectrum  optical  pyrometers  using  CCD  or  CMOS  sensors  have  been  developed  by 
a  number  of  groups.  T.  Fu  and  coworkers  have  performed  extensive  work  on  the  theory  and 
optimization  of  color  imaging  pyrometers  (2-5).  Pyrometers  based  on  either  CCD  or  CMOS 
color  imaging  devices  have  been  used  to  measure  soot  temperature  and  concentrations  (6-8), 
laser  weld  temperatures  (9),  and  silicone  carbide  fibers  (10). 

We  characterized  and  calibrated  a  high  speed  Phantom  Vision  Research  (11)  color  camera 
for  use  as  an  optical  pyrometer.  Complete  calibration  of  the  digital  color  camera  is  required 
for  its  use  as  a  pyrometer.  The  two  components  that  need  to  be  characterized  are  the  color 
hlter  array  (CFA)  sensitivity  and  an  overall  calibration  factor.  Raw  gray-scale  data  from 
the  CFA  is  used  in  conjunction  with  a  physical  model  to  determine  the  temperature  of  the 
imaged  scene.  The  fundamental  basis  for  the  analysis  assumes  that  the  collected  light  is 
from  a  self-luminous  object  that  behaves  as  a  gray-body  emitter.  The  analysis  follows  the 
two-wavelength  ratio  method  (12-13),  extended  to  the  broadband  regime,  using  the  light 
intensity  collected  from  the  CFA.  Temperature  calculations  can  be  performed  on  movie  or 
image  hies,  if  proper  analysis  of  the  color  imaging  pipeline  is  taken  into  account.  The  color 
image  processing  pipeline  performs  operations  on  the  raw  CFA  data  that  could  potentially 
introduce  errors  in  the  apparent  temperature.  Processing  operations  that  may  corrupt  the 
data  and  cause  an  erroneous  temperature  are  discussed  in  section  2.1. 


2.  Digital  Color  Imaging 


Most  high  speed  color  cameras  consist  of  a  panchromatic  complementary  metal-oxide-semiconductor 
imaging  sensor  that  is  sensitive  to  light  between  350-1100  nm.  On  top  of  the  image  sensor 
is  a  CFA  that  allows  the  production  of  color  images.  The  CFA  is  a  mosaic  arrangement 
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Figure  1.  The  Bayer  color  filter  array  (15). 


of  color  filters.  In  addition  to  the  CFA,  most  cameras  have  an  infrared  (IR)  cutoff  hlter  to 
block  radiation  imperceptible  to  the  human  visual  system. 

Camera  systems  are  designed  to  replicate  a  scene  as  seen  by  the  human  visual  system.  Each 
pigment  or  dye  based  color  hlter  transmits  a  selected  portion  of  the  visible  spectrum  to  the 
pixel  beneath  it.  The  spectral  transmission  of  the  color  hlters  are  designed  to  closely  follow 
the  color  matching  functions  dehned  by  the  International  Commission  of  Illumination  (CIE), 
which  describe  the  chromatic  response  of  a  standard  observer’s  eye  (14)-  To  ensure  correct 
color  reproduction,  the  color  hlters  transmission  should  be  a  linear  transformation  of  these 
color  matching  functions.  This  requirement,  however,  makes  most  camera  hlters  non-ideal 
for  use  as  a  pyrometer.  Nonetheless,  it  is  not  cost  ehective  to  design  and  build  a  camera 
with  hlters  for  temperature  measurements. 

The  most  common  CFA  used  is  the  Bayer  pattern  (^15).  However,  a  number  of  other  CFA 
patterns  have  been  developed  (16-18)  and  are  used  in  commercial  cameras.  The  Bayer 
pattern  is  composed  of  a  2  x  2  matrix  with  one  red,  one  blue,  and  two  green  hlters,  hgure 
1.  As  the  human  visual  system  is  more  sensitive  to  the  green  region  of  the  visible  spectrum, 
there  are  twice  as  many  green  hlters.  As  each  pixel  is  sensitive  to  only  one  color  channel,  a 
demosaicing  algorithm  is  necessary  to  recover  a  full  color  image  consisting  of  red,  green,  and 
blue  values  for  each  pixel.  This  algorithm  interpolates  the  two  missing  color  values  using 
adjacent  pixel  values  in  the  raw  CFA  image. 

Since  each  pixel  has  one  color  hlter,  the  red,  green,  and  blue  color  channels  are  sub-sampled 
across  the  image  sensor.  The  sub-sampling  introduces  a  nyquist  frequency  /„.  Spacial  signals 
that  have  a  frequency  above  fu,  are  aliased  and  can  not  be  fully  interpolated.  The  aliasing 
of  the  color  channels  will  cause  errors  in  the  color  reproduction. 


2.1  Image  Processing 

A  generic  outline  of  the  steps  taken  to  transform  a  raw  gray-scale  CFA  image  to  a  full 
color  image  is  shown  in  hgure  2.  The  steps  that  are  of  most  importance  for  pyrometric 
measurements  are  CFA  demosaicing,  white  balancing,  and  gamma-correction. 
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Figure  2.  The  color  imaging  processing  pipeline.  A  generic  outline  of  steps  that  must 
be  taken  to  transform  light  collected  by  a  lens  to  reproduce  a  full  color  image 
suitable  for  viewing  (19-24)- 


A  full  color  image  consists  of  pixels  possessing  three  values  that  represent  the  red,  green, 
and  blue  color  channels.  These  three  colors  are  combined  to  produce  a  color  gamut.  A 
demosaicing  algorithm  is  used  to  create  a  full  color  image  from  the  CFA  image.  Modern 
demosaicing  algorithms  may  be  nonlinear,  and  adaptive  to  the  scene.  Many  are  also  propri¬ 
etary  to  the  camera  manufacturer  and  therefore  unpublished.  Vision  Research’s  Cine  Viewer 
software  offers  six  different  demosaicing  methods  from  “fastest”  to  “best” .  The  quality  and 
RGB  values  of  an  image  change  depending  on  what  method  is  chosen.  Different  demosaicing 
methods  can  be  found  in  references  (25-29). 


The  present  research  has  developed  a  custom  demosaicing  algorithm  to  retain  data  hdelity. 
A  {nx  n)  mean-interpolation  scheme  is  used  to  reconstruct  a  full  color  image  from  the  CFA 
image.  For  each  pixel,  the  RGB  values  are  calculated  as  the  mean  value  from  inside  a  (n  x  n) 
kernel;  color  values  that  are  missing  in  the  CFA  are  ignored  in  the  mean  value  calculation. 
This  calculation  is  modihed  near  the  edge  of  the  image  to  only  include  elements  within  the 
image.  In  hgure  3,  a  mean  method  is  used  to  calculate  the  RGB  values  at  pixel  (3,3)  which 
is  described  by  the  following. 
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The  (n  x  n)  mean  demosaicing  method  acts  like  a  low-pass  hlter  removing  possible  high 
frequency  spatial  signals  that  can  not  be  measured  by  the  GFA.  As  with  all  demosaicing 
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Figure  3.  A  Bayer  CFA  pattern  with  a  (3  x  3)  kernel  used  to  calculate  the  mean  values 
of  the  RGB  channels  at  pixel  (3,3). 
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methods,  there  is  a  downside:  the  edges  inside  the  image  are  not  handled  well.  As  a  result, 
smoothing  and  false  coloring  are  introduced  by  the  “zipper  effect”  textit  (28,  29).  These 
artifacts  cause  inaccurate  color  channel  ratios  along  edges,  ultimately  resulting  in  erroneous 
temperature  calculations  at  edges.  While  more  advanced  methods  could  be  used  to  obtain 
correct  colors,  these  methods  rely  on  correlations  between  the  RGB  channels  and  should  be 
avoided  because  the  temperature  calculation  depends  on  the  color  channel  ratio. 

After  the  full  color  RGB  image  is  obtained,  white  balancing  is  performed  to  correct  for 
the  spectral  distribution,  i.e.,  color  temperature,  of  the  illumination  source,  (hgure  4)  (19). 
While  the  human  visual  system  is  capable  of  automatically  adjusting  to  the  illumination 
source  color  temperature,  colors  measured  by  image  sensors  depend  on  the  illumination 
source.  The  measured  color  of  a  white  object  depends  on  the  color  temperature  of  the 
source.  For  example,  a  white  object  illuminated  by  a  tungsten  light  (Tc=3000  K)  appears 
reddish,  under  direct  sunlight  (Tc=5000  K)  appears  neutral,  and  under  overcast  conditions 
(Tc=9000  K)  appears  blueish.  This  is  clearly  an  undesirable  effect  within  consumer  photog¬ 
raphy.  The  white  point  is  dehned  by  the  source  illuminant  or  by  imaging  a  known  neutral 
object  if  the  illuminant  is  unknown.  Once  the  white  point  is  known,  the  RGB  values  are 
scaled  by  an  appropriate  value,  R^,  G^,  and  B^ 

(  Rb\  (  255/R^  0  0  \  /  Ru\ 

Of,  =  0  255/G^  0 

\Bf,  J  \  0  0  255/R^  )  \Bu  J 

where  the  u  subscript  is  for  the  unbalanced  raw  data  and  the  b  subscript  is  for  white  balanced 
values.  This  correction  ensures  that  white  objects  appear  white  in  an  image  regardless  of 
the  illumination  source.  The  fundamental  assumption  of  the  pyrometric  analysis  is  that 
temperature  calculations  are  performed  only  on  self-luminous  objects  that  behave  as  gray- 
body  emitters.  Since  the  temperature  calculation  depends  on  the  spectral  characteristic  of 
the  radiation,  any  adjustments  to  the  RGB  values  would  cause  an  error  in  the  temperature. 
White  balancing  must  be  considered  if  analyzing  processed  movie  or  image  files. 

Gharged  coupled  devices  and  GMOS  imaging  sensors  are  linear  devices.  Their  pixel  values 
are  proportional  to  the  exposure,  where  the  exposure  is  a  product  of  light  intensity  and  count 
duration.  But,  since  the  human  visual  system  is  highly  nonlinear  with  respect  to  exposure, 
most  color  spaces  and  storage  formats  have  been  designed  with  a  gamma-correction  (7).  The 
simplest  7-correction  is  a  power-law  that  relates  the  photo-site  voltage  to  the  pixel  value, 

pixelvalue  =  (^4j 

When  the  image  is  viewed,  the  pixel  values  are  decompressed  by, 

Vout  =  pixelvalue^.  (5) 


5 


wavelength  (m) 


Figure  4.  White  balance  is  performed  to  correct  for  the  spectral  distribution  of  the 
source  illuminate.  A  white  object  under  a  Tc=3000  K  light  will  appear  blue, 
Tc=5000  K  will  appear  neutral,  and  Tc=9000  K  will  appear  red.  The  intensity 
has  been  normalized  at  575  nm. 


Figure  5.  A  power  law  gamma  correction  relating  the  voltage  from  the  sensor  (Vj„)  and 
the  voltage  out  or  pixel  value  (Vout)- 

The  default  gamma  value  for  most  camera  systems  is  2.2,  which  is  also  the  gamma  value  for 
the  common  sRGB  color  space  (30). 

Figure  5  shows  a  linear,  y-compressed,  and  decompressed  curves.  Darker  regions  corre¬ 
spond  to  small  values  of  Vin  and  brighter  regions  correspond  to  large  values  of  Vin-  The 
y-compressed  curve  expands  the  darker  regions  while  the  brighter  regions  are  compressed. 
When  the  image  is  displayed,  the  pixel  values  are  decompressed,  and  a  linear  relationship 
between  the  exposure  and  pixel  value  is  regained.  A  considerable  error  in  the  temperature 
can  occur  if  the  y-correction  is  not  properly  taken  into  account. 
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2.2  Physical  Model 


Blackbody  radiation  was  first  described  by  Planck  in  1901  (31).  The  spectral  radiance  of  a 
blackbody  depends  only  on  the  temperature  T  and  wavelength  A, 


L(A,T) 


C*!  e(A,T) 

A5  eC2/T\  _  1  ’ 


(6) 


where  Ci  =  37413  *  10“^°  [W/m^],  C2  =  14388  *  10“®  [mK],  and  e(A,T)  is  the  surface 
emissivity.  For  a  blackbody,  e(A,  T)  =  1  in  equation  3,  whereas  real  objects  have  an  emissivity 
of  less  than  one.  We  assume  that  emissivity  is  constant  over  the  visible  region,  a  graybody 
assumption  (32). 


A  linear  response  model  (33)  was  used  to  develop  an  analytical  expression  for  the  raw  CFA 
values,  equation  4  response  D  to  an  input  spectral  power  density  S'(A)  is 

D  =  ^iAAdAudAt  j  r(A)S'(A)xi(A)(iA,  (7) 

where  the  index  i  is  one  of  the  color  channels  (red,  green,  or  blue),  Tj  is  the  gain  of  the 
internal  electronics,  Xj(A)  is  the  spectral  sensitivity  of  the  color  hlter,  r(A)  is  the  transmission 
through  the  lens,  AAd  is  the  area  of  the  pixel,  Auid  is  the  solid  angle  subtended  by  the  pixel, 
and  At  is  the  exposure  time.  The  integral  range  is  over  the  visible  region  of  the  spectrum. 
We  assume  that  the  transmission  through  the  lens  is  wavelength  independent. 


Since  the  absolute  RGB  value  of  each  pixel  is  not  calculable,  a  two-color  ratio  analysis  is 
performed  to  calculate  a  temperature  at  each  pixel  (13,  12).  With  equations  3  and  4,  an 
expression  for  the  ratio  of  two  color  channels  can  be  calculated. 

Green  / L{\T)x,{\)d\ 

=  ^7 - •  (8) 

L{X,T)xr{X)dX 

For  the  temperature  range  of  interest,  the  green  and  red  channels  are  most  appropriate  as 
they  provide  the  largest  signal-to- noise  value.  However,  the  green/blue  or  red/blue  ratio 
may  be  used  if  higher  temperatures  are  expected.  An  overall  calibration  factor  Cgr  = 
is  required  because  the  absolute  light  intensity,  lens  optics,  and  internal  camera  electronics 
are  unknown.  This  was  measured  by  imaging  a  calibrated  blackbody  source,  section  2.3. 


2.3  Device  Characterization 


Since  the  dyes  (pigments)  used  in  the  CFA  are  nonideal,  their  spectral  transmittance  must  be 
known  to  calculate  the  analytical  calibration  curve,  equation  5.  There  are  several  methods 
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Figure  6.  Spectral  transmittance  of  the  filters  that  compose  the  CFA.  The  data  is  in 
excellent  agreement  with  the  manufacture’s  data. 

available  to  measure  the  spectral  transmittance  of  color  filters,  see  (34,  34,  20).  For  this 
experiment,  a  monochromator,  standard  light  source,  photomultiplier  tube  (PMT),  and  color 
camera  were  used  to  measure  the  spectral  response  of  the  filters  used  in  the  color  filter  array. 
The  output  of  the  monochromator  was  imaged  with  the  color  camera  and  then  measured 
with  the  PMT.  Discrete  measurements  were  made  between  400  and  700  nm  in  5  nm  steps. 
The  camera’s  response  at  pixels  representing  the  different  color  filters  Qi{X)  ( i  =  red,  green, 
and  blue)  is  related  to  the  measured  PMT  signal  T’(A)  by, 

Q.(A)=x*(A)*P(A),  (9) 

where  Xj(A)  is  the  spectral  transmittance  of  the  color  filters.  The  manufacturer’s  published 
PMT  sensitivity  was  used  to  correct  the  PMT  signal.  A  singular  value  decomposition  was 
used  to  solve  the  set  of  linear  equations  in  equation  6.  The  measured  spectral  sensitivity  of 
the  filters  used  in  the  cameras  CFA  is  shown  in  figure  6,  and  is  in  excellent  agreement  with 
the  data  provided  by  the  camera’s  manufacturer  (36). 


The  overall  calibration  factor  Cgr  in  equation  5  was  measured  with  an  Omega  BB-4  blackbody 
source.  The  constant  is  independent  of  light  intensity  and  constant  at  temperatures  above 
1100  K.  The  analytical  curve  and  the  measured  blackbody  data  are  shown  in  figure  7.  At 
temperatures  below  1100  K,  the  signal-to-noise  increases  significantly,  as  the  maximum  in 
the  Planck  curve  moves  to  longer  wavelengths  of  the  infrared  region  and  less  light  is  emitted 
in  the  visible  region. 


2.4  Noise 


A  potential  source  of  noise  and  non-linearity  in  the  system  is  dark  current,  which  is  one 
of  the  largest  sources  of  noise  in  digital  imagers.  Further  sources  of  noise  can  be  found 


green/red 


Figure  7.  The  analytical  calibration  curve  equation  5  (blue  curve)  and  measured  data 
from  a  blackbody  source,  red  triangles. 


in  reference  (19),  but  will  not  be  discussed  here.  Dark  current  is  generated  by  thermally 
excited  electrons  that  accumulate  at  the  photo-site.  It  has  been  shown  that  the  dark  current 
of  a  sensor  depends  on  its  temperature  and  the  exposure  duration  (37).  Images  taken  at 
short  exposure  durations  suffered  from  signihcant  dark  current  noise.  To  correct  for  the  dark 
current  noise,  a  baseline  image  was  taken  with  a  cap  covering  the  lens  and  was  subtracted 
from  the  actual  image.  A  baseline  image  was  taken  whenever  the  camera  settings  or  ambient 
temperature  changed. 


3.  Results  -  High  Explosive  Imaging 


Detonated  high  explosives  produce  a  rapidly  expanding  fireball  of  detonation  products.  If 
the  explosive  is  underoxidized,  the  excess  fuel  burns  with  atmospheric  oxygen  (a  process 
known  as  afterburning)  (38).  Soot-like  particles  of  unburned  fuel  or  other  solids  account  for 
the  majority  of  the  emitted  light.  These  particles  emit  like  a  graybody  which  is  described 
by  Planck’s  law,  equation  3  (32).  Since  the  surface  of  the  hreball  is  optically  thick,  the  light 
from  the  interior  is  not  imaged  by  the  camera. 
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The  color  camera  pyrometer  has  been  used  to  measure  the  surface  temperature  of  centrally 
detonated  spherical  C-4  charges  with  a  mass  of  228  grams  and  suspended  above  a  1.5  square 
meter  steel  table.  In  addition  to  the  color  pyrometer,  three  other  pyrometers  were  used  to 
measure  the  temperature  of  the  exploded  charges.  The  full  test  results  are  reported  in  (39). 

Proper  exposure  setting  is  critical  for  obtaining  temperature  measurements  of  high  explo¬ 
sives.  Saturation  and  blooming  occurs  when  the  exposure  time  is  too  long,  while  an  exposure 
time  that  is  too  short  will  cause  the  image  to  appear  dark  and  possess  a  small  signal-to-noise 
ratio.  For  all  test  shots,  a  2  /rs  exposure  was  used  with  an  f/22  35  mm  lens.  These  settings 
provide  images  with  sufficient  light.  The  camera’s  maximum  resolution  is  1024  x  1024,  how¬ 
ever,  the  region  of  interest  required  a  smaller  area  which  increased  the  camera’s  maximum 
frame  rate  to  33,000  frames  per  second  in  some  shots.  The  camera  was  operated  in  the  cir¬ 
cular  buffer  mode.  In  this  mode,  a  set  number  of  frames  is  recorded  after  the  trigger  pulse, 
with  the  remainder  of  the  camera’s  memory  hlled  by  images  before  the  trigger  pulse.  As 
a  consequence,  the  start  of  an  exposure  is  not  synchronized  to  the  start  of  the  detonation. 
There  is  always  a  “jitter”  of  at  least  one  frame  in  the  absolute  timing  of  the  event.  The 
surface  temperature  of  an  exploded  charge  is  shown  in  hgure  8.  The  surface  temperature  is 
relatively  homogeneous  with  a  variation  of  approximately  75  K.  All  measured  charges  showed 
similar  temperature  maps.  A  spectrograph  was  used  to  characterize  any  discreet  emission 
or  absorption.  The  only  observable  emission  was  from  the  sodium  doublet  at  589  nm.  The 
strength  of  Na  emission  caused  a  10  K  error  in  the  calculated  temperature.  There  was  no 
sign  of  signihcant  gaseous  emission  in  the  wavelength  region  of  interest. 
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Figure  8.  Surface  temperature  maps  of  exploded  C-4  charges.  The  time  between  frames 
is  77  /is  with  a  2  /rs  exposure.  The  surface  temperature  is  relatively  homoge¬ 
neous  with  a  standard  deviation  of  75  K.  The  temperature  is  not  calculated 
in  the  white  regions  because  the  light  level  was  approximately  the  background 
value. 


4.  Conclusion 


We  have  characterized  and  calibrated  a  high  speed  color  camera  that  can  be  used  as  an 
optical  pyrometer.  Raw  images  from  the  camera’s  CFA  provide  the  spectral  resolution 
necessary  to  perform  a  two-color  ratio  analysis.  If  processed  image  or  movie  hies  are  available 
for  analysis,  then  proper  accounting  of  the  digital  color  imaging  pipeline  is  mandatory  for 
accurate  temperature  calculations.  This  technique  has  been  used  to  measure  the  surface 
temperature  of  exploded  C-4  charges  with  time  resolution  on  the  microsecond  scale.  Future 
work  is  planned  to  include  a  variable  emissivity  of  sooting  hames  (40-44)- 
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